STB-VMM: Swin Transformer based Video Motion Magnification

نویسندگان

چکیده

The goal of video motion magnification techniques is to magnify small motions in a reveal previously invisible or unseen movement. Its uses extend from bio-medical applications and deepfake detection structural modal analysis predictive maintenance. However, discerning noise complex task, especially when attempting very subtle, often sub-pixel As result, generally suffer noisy blurry outputs. This work presents new state-of-the-art model based on the Swin Transformer, which offers better tolerance inputs as well higher-quality outputs that exhibit less noise, blurriness, artifacts than prior-art. Improvements output image quality will enable more precise measurements for any application reliant magnified sequences, may further development technical fields.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Review: Eulerian Video Motion Magnification

Thispaper reviews computational techniques to efficiently represent, analyse and visualise both shortterm and long-term temporal variation in video and image sequences. This paper reveals temporal variation in videos that are imperceptible to the naked eye. The method takes a standard video sequence as an input, and applies spatial decomposition, followed by temporal filtering to the frames whi...

متن کامل

Structural Modal Identification Through High Speed Camera Video: Motion Magnification

Video cameras offer the unique capability of collecting high density spatial data from a distant scene of interest. They could be employed as remote monitoring or inspection sensors because of their commonplace use, simplicity, and relatively low cost. The difficulty is in interpreting the video data into a usable format, such as displacement, that is familiar to engineers. A methodology called...

متن کامل

An Improved Motion Vector Estimation Approach for Video Error Concealment Based on the Video Scene Analysis

In order to enhance the accuracy of the motion vector (MV) estimation and also reduce the error propagation issue during the estimation, in this paper, a new adaptive error concealment (EC) approach is proposed based on the information extracted from the video scene. In this regard, the motion information of the video scene around the degraded MB is first analyzed to estimate the motion type of...

متن کامل

Multi-point Vibration Measurement for Mode Identification of Bridge Structures using Video-based Motion Magnification

Image-based vibration mode identification gained increased attentions in civil and construction communities. A recent video-based motion magnification method was developed to measure and visualize small structure motions. This new approach presents a potential for low-cost vibration measurement and mode shape identification. Pilot studies using this approach on simple rigid body structures was ...

متن کامل

A New Wavelet Based Spatio-temporal Method for Magnification of Subtle Motions in Video

Video magnification is a computational procedure to reveal subtle variations during video frames that are invisible to the naked eye. A new spatio-temporal method which makes use of connectivity based mapping of the wavelet sub-bands is introduced here for exaggerating of small motions during video frames. In this method, firstly the wavelet transformed frames are mapped to connectivity space a...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Knowledge Based Systems

سال: 2023

ISSN: ['1872-7409', '0950-7051']

DOI: https://doi.org/10.1016/j.knosys.2023.110493